Papers with vanilla counterpart
Reducing Disambiguation Biases in NMT by Leveraging Explicit Word Sense Information (2022.naacl-main)
Copied to clipboard
| Challenge: | Recent studies show that Neural Machine Translation models struggle to disambiguate polysemous words without lapsing into their most frequent senses. |
| Approach: | They propose a way to automatically create high-precision sense-annotated parallel corpora . they then propose 'fine-tuning' strategies to exploit these sense annotations during training . |
| Outcome: | The proposed approach achieves higher BLEU scores than its vanilla counterpart in 3 language pairs. |
DarkBERT: A Language Model for the Dark Side of the Internet (2023.acl-long)
Copied to clipboard
| Challenge: | Recent research suggests that there are clear differences in the language used in the Dark Web compared to that of the Surface Web. |
| Approach: | They propose a language model that is pretrained on Dark Web data to combat extreme lexical diversity. |
| Outcome: | The proposed model outperforms existing models and may be useful for future research on the Dark Web. |